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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an automatic performance control device in 
which a tempo is made to be controllable for each part in automatic performance, and 
the tempo control for each part is opened to a user. 

SOLUTION: An automatic performance control device 3 automatically performs music 
data composed of plural parts and each of them has a performance data track for 
controlling sound generation and muffling, and a tempo control data track for 
controlling a performance tempo. Then, for some parts, the tempo is controlled 
without using the data of the tempo control data track, but is controlled based on a 
tempo control data generated on the basis of an operation data for a manual controller 
1 to be operated by the user. Thus, the user can easily participate in the performance. 
Moreover, it is possible to record the user participatory performance by writing this 
generated tempo control data in the tempo control data track. 
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CLAIMS 



[Claim(s)] 

[Claim 1] The read-out control unit of time series data equipped with a storage means 
to memorize two or more time series data, and the read-out control means which is a 
means which reads these two or more time series data by predetermined read-out II 
Tempo, reads according to each network based on the II Tempo control data for every 
network, and controls II Tempo. 

[Claim 2] The II Tempo control data for said every network is the read-out control 
unit of said time series data according to claim 1 memorized by said storage means 
with the time series data of a network. [ two or more ] 

[Claim 3] It is the read-out control unit of time series data according to claim 1 or 2 
controlled based on the II Tempo control data to which two or more II Tempo control 
data were generated based on the actuation data with which, as for two or more 



preparations and the aforementioned read-out control means, two or more of said 
actuation means outputted an actuation means outputted the actuation data 
according to actuation of a user, each II Tempo control data was assigned to the 
respectively different network, and read-out II Tempo of each network was assigned 
by the network concerned. 

[Claim 4] The aforementioned read-out control means is the read-out control unit of 
the time series data according to claim 3 which write the II Tempo control data 
assigned to each network in said storage means as II Tempo control data for every 
network. 

[Claim 5] An actuation means to output the actuation data according to actuation of a 
user 1 or two or more preparations, and the aforementioned read-out control means 
The II Tempo control data is generated based on the actuation data which the 
actuation means outputted. The read-out control unit of time series data according to 
claim 2 controlled by said II Tempo control data which controls two or more said 
read-out II Tempo of a partial network by said generated II Tempo control data among 
networks, and is memorized by said storage means in said read-out II Tempo of other 
networks. 

[Claim 6] The aforementioned read-out control means is the read-out control unit of 
said time series data according to claim 5 written in said storage means as II Tempo 
control data of a network in part about said generated II Tempo control data. 
[Claim 7] It is the read-out control unit of the time series data according to claim 1 to 
6 which are equipped with an actuation means output the actuation data according to 
actuation of a user, the aforementioned read-out control means generates correction 
data based on the actuation data which the actuation means outputted, correct the II 
Tempo control data for every network of said by this correction data, and control 
read-out II Tempo of time series data according to each of said network based on this 
corrected II Tempo control data. 

[Claim 8] Said actuation means is the read-out control unit of time series data 
[ equipped with a sensor means to exercise with the body and to detect the 
movement mode or a posture condition, and an actuation data output means to 
generate actuation data based on the contents of detection of this sensor means ] 
according to claim 3 to 7. 

[Claim 9] The performance control unit equipped with a storage means to memorize 
the music data which have multiple part's performance data, and the performance 
control means which is a means which reads this multiple part's performance data by 
predetermined read-out II Tempo, reads according to each PERT based on the II 
Tempo control data for every PERT, and controls II Tempo. 

[Claim 10] The II Tempo control data for said every PERT is a performance control 
unit according to claim 9 memorized by said storage means with said multiple part's 
performance data. 



[Claim 11] It is the performance control unit according to claim 9 or 10 controlled 
based on the II Tempo control data to which two or more II Tempo control data were 
generated based on the actuation data with which, as for two or more preparations 
and said performance control means, said two or more actuation means outputted an 
actuation means to output the actuation data according to actuation of a user, each II 
Tempo control data was assigned to respectively different PERT, and each PERT's 
read-out II Tempo was assigned by the PERT concerned. 

[Claim 12] Said performance control means is a performance control unit according to 
claim 1 1 which writes the II Tempo control data assigned to each PERT in said storage 
means as II Tempo control data for every PERT. 

[Claim 13] 1 or two or more preparations, and said performance control means are the 
performance control unit according to claim 10 which generates II Tempo control data 
based on the actuation data with which the actuation means outputted an actuation 
means outputted the actuation data according to actuation of a user, controls said 
read-out II Tempo of partial PERT by said generated II Tempo control data among said 
multiple part, and controls said read-out II Tempo of other PERT by the II Tempo 
control data memorized by said storage means. 

[Claim 14] Said performance control means is said performance control unit according 
to claim 13 written in said storage means as PERT's II Tempo control data in part 
about said generated II Tempo control data. 

[Claim 15] It is the performance control unit according to claim 9 to 14 which is 
equipped with an actuation means output the actuation data according to actuation of 
a user, said performance control means generates correction data based on the 
actuation data which the actuation means outputted, corrects the II Tempo control 
data for every PERT of said by this correction data, and controls read-out II Tempo of 
performance data according to each of said PERT based on this corrected II Tempo 
control data. 

[Claim 16] Said actuation means is the performance control unit [ equipped with a 
sensor means to exercise with the body and to detect the movement mode or a 
posture condition, and an actuation data output means to generate actuation data 
based on the contents of detection of this sensor means ] according to claim 1 1 to 1 5. 
[Claim 17] Said storage means is a performance control unit according to claim 9 to 
16 which reads said indicative data based on the II Tempo control data corresponding 
to [ have memorized the indicative data corresponding to each PERT, and ] each 
PERT in said performance control means, and controls a display. 
[Claim 18] Said performance data are a performance control unit according to claim 9 
to 1 7 which is sequence data which consist of read-out timing of event data and 
these event data. 

[Claim 19] Said performance data are a performance control unit according to claim 9 
to 1 7 which is the data point of the time series which recorded the performance sound. 



[Claim 20] The image reproduction control unit equipped with a storage means to 
memorize two or more image data which display a respectively different image, and 
the playback control means which is a means which reads this two or more image data 
by predetermined read-out II Tempo, reads according to each network based on the II 
Tempo control data for every network, and controls II Tempo. 

[Claim 21] The II Tempo control data for said every network is said image 
reproduction control unit according to claim 20 memorized by said storage means with 
the image data of a network. [ two or more ] 

[Claim 22] It is the image-reproduction control unit according to claim 20 or 21 
controlled based on the II Tempo control data to which two or more II Tempo control 
data were generated based on the actuation data with which, as for two or more 
preparations and said playback control means, said two or more actuation means 
outputted an actuation means to output the actuation data according to actuation of 
a user, each II Tempo control data was assigned to the respectively different network, 
and read-out II Tempo of each network was assigned by the network concerned. 
[Claim 23] Said playback control means is an image reproduction control unit 
according to claim 22 which writes the II Tempo control data assigned to each 
network in said storage means as II Tempo control data for every network. 
[Claim 24] It is the image-reproduction control unit according to claim 21 which 
generates II Tempo control data based on the actuation data with which, as for 1 or 
two or more preparations, and said playback control means, an actuation means 
outputted an actuation means output the actuation data according to actuation of a 
user, and controls by said II Tempo control data which controls two or more said 
read-out II Tempo of a partial network by said generated II Tempo control data among 
networks, and is memorized by said storage means in said read-out II Tempo of other 
networks. 

[Claim 25] Said playback control means is said image reproduction control unit 
according to claim 24 written in said storage means as PERT's II Tempo control data 
in part about said generated II Tempo control data. 

[Claim 26] It is the image-reproduction control unit according to claim 20 to 25 which 
is equipped with an actuation means output the actuation data according to actuation 
of a user, said performance control means generates correction data based on the 
actuation data which the actuation means outputted, corrects the II Tempo control 
data for every network of said by this correction data, and controls read-out II Tempo 
of image data according to each of said network based on this corrected II Tempo 
control data. 

[Claim 27] Said actuation means is the performance control unit [ equipped with a 
sensor means to exercise with the body and to detect the movement mode or a 
posture condition, and an actuation data output means to generate actuation data 
based on the contents of detection of this sensor means ] according to claim 22 to 26. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the read-out control device of the 
time series data which control read-out II Tempo of the time series data which consist 
of two or more lines according to a network, the performance control device which 
controls read-out II Tempo of the performance data which consist of multiple part 
according to PERT, and the image reproduction control device which controls 
read-out II Tempo of the image data which consist of two or more image data which 
display a respectively different image according to a network. 
[0002] 

[Problem(s) to be Solved by the Invention] Multiple part's performance data are one of 
typical things of the time series data which consist of two or more lines, and there is 
automatic performance equipment as a performance control unit which controls 
read-out of this multiple part's performance data. Although common automatic 
performance equipment had the function which carries out the automatic 
performance of multiple part's musical piece based on multiple part's music data, it is 
only reading each PERT's performance data based on the same II Tempo control data, 
and conventional automatic performance equipment was not able to carry out 
different II Tempo control for every PERT. For this reason, however it might perform, 
each PERT's pronunciation / silence timing is the same, and was not able to give 
change to a performance. 

[0003] Moreover, when carrying out start actuation of pushing a play carbon button, 
the musical piece was performed automatically, the conventionally general automatic 
performance function did not have room for a user to operate it after it, and a user 
was not able to participate in a performance and it was not able to control a 
performance, for this reason — moreover, when it was going to enjoy concert, it was 
difficult for each user to be able to play musical instruments (performance equipment), 
such as a keyboard, to have to require skill, and for each concert person to have to be 
in coincidence on that occasion, and to gather the player of the number corresponding 
to multiple part to coincidence. 

[0004] By this invention having enabled it to control II Tempo for every PERT in an 
automatic performance, and having opened each PERT's II Tempo control wide to the 
user, the performance which was rich in change is enabled, and it aims at offering the 
performance control device which lowered the threshold of a musical performance as 
could participate in concert by easy actuation and the read-out control device of time 



series data, and an image reproduction control device. 
[0005] 

[Means for Solving the Problem] The read-out control devices of the time series data 
which are invention of claim 1 are a storage means to memorize two or more time 
series data, and a means which reads these two or more time series data by 
predetermined read-out II Tempo, and are characterized by having the read-out 
control means which reads according to each network based on the II Tempo control 
data for every network, and controls II Tempo. The performance control devices which 
are invention of claim 9 are a storage means to memorize the music data which have 
multiple part's performance data, and a means which reads this multiple part's 
performance data by predetermined read-out II Tempo, and are characterized by 
having the performance control means which reads according to each PERT based on 
the II Tempo control data for every PERT, and controls II Tempo. The image 
reproduction control devices which are invention of claim 20 are a storage means to 
memorize two or more image data which display a respectively different image, and a 
means which reads this two or more image data by predetermined read-out II Tempo, 
and are characterized by having the playback control means which reads according to 
each network based on the II Tempo control data for every network, and controls II 
Tempo. 

[0006] In invention of claim 1, the II Tempo control data for said every network is 
characterized by two or more said things [ that said storage means memorizes ] with 
the time series data of a network by invention of claim 2. Invention of claim 10 is 
characterized by the II Tempo control data for said every PERT being memorized by 
said storage means with said multiple part's performance data in invention of claim 9. 
In invention of claim 20, the II Tempo control data for said every network is 
characterized by two or more said things [ that said storage means memorizes ] with 
the image data of a network by invention of claim 21. 

[0007] Two or more preparations and the aforementioned read-out control means are 
characterized by to control based on the II Tempo control data to which two or more 
II Tempo control data generated based on the actuation data with which two or more 
of said actuation means outputted an actuation means to by_which invention of claim 
3 outputs the actuation data according to actuation of a user in invention of claims 1 
and 2, each II Tempo control data assigned a respectively different network, and 
read-out II Tempo of each network was assigned by the network concerned. Two or 
more preparations and said performance control means are characterized by to 
control based on the II Tempo control data to which two or more II Tempo control data 
generated based on the actuation data with which two or more of said actuation 
means outputted an actuation means to by_which invention of claim 1 1 outputted the 
actuation data according to actuation of a user in invention of claims 9 and 10, each II 
Tempo control data assigned respectively different PERT, and each PERT's read-out 



II Tempo was assigned by the PERT concerned. Two or more preparations and said 
playback control means are characterized by to control based on the II Tempo control 
data to which two or more II Tempo control data generated based on the actuation 
data with which two or more of said actuation means outputted an actuation means to 
by_which invention of claim 22 outputted the actuation data according to actuation of 
a user in invention of claims 20 and 21, each II Tempo control data assigned a 
respectively different network, and read-out II Tempo of each network was assigned 
by the network concerned. 

[0008] Invention of claim 4 is characterized by the aforementioned read-out control 
means writing the II Tempo control data assigned to each network in said storage 
means as II Tempo control data for every network in invention of claim 3. Invention of 
claim 12 is characterized by said performance control means writing the II Tempo 
control data assigned to each PERT in said storage means as II Tempo control data 
for every PERT in invention of claim 1 1 . Invention of claim 23 is an image reproduction 
control unit according to claim 22 which writes the II Tempo control data with which 
said playback control means was assigned to each network in invention of claim 22 in 
said storage means as II Tempo control data for every network. 

[0009] Invention of claim 5 an actuation means to output the actuation data according 
to actuation of a user, in invention of claim 2 1 or two or more preparations, and the 
aforementioned read-out control means The II Tempo control data is generated based 
on the actuation data which the actuation means outputted. It is characterized by 
controlling by said II Tempo control data which controls two or more said read-out II 
Tempo of a partial network by said generated II Tempo control data among networks, 
and is memorized by said storage means in said read-out II Tempo of other networks. 
Invention of claim 13 an actuation means to output the actuation data according to 
actuation of a user, in invention of claim 10 1 or two or more preparations, and said 
performance control means The II Tempo control data is generated based on the 
actuation data which the actuation means outputted. It is characterized by controlling 
said read-out II Tempo of partial PERT by said generated II Tempo control data among 
said multiple part, and controlling said read-out II Tempo of other PERT by the II 
Tempo control data memorized by said storage means. Invention of claim 24 an 
actuation means to output the actuation data according to actuation of a user, in 
invention of claim 21 1 or two or more preparations, and said playback control means 
The II Tempo control data is generated based on the actuation data which the 
actuation means outputted. It is characterized by controlling by said II Tempo control 
data which controls two or more said read-out II Tempo of a partial network by said 
generated II Tempo control data among networks, and is memorized by said storage 
means in said read-out II Tempo of other networks. 

[0010] As for the aforementioned read-out control means, invention of claim 6 is 
characterized for said generated II Tempo control data by said thing [ writing a part in 



said storage means as II Tempo control data of a network ] in invention of claim 5. As 
for said performance control means, invention of claim 14 is characterized for said 
generated II Tempo control data by said thing [ writing a part in said storage means as 
PERT's II Tempo control data ] in invention of claim 13. As for said playback control 
means, invention of claim 25 is characterized for said generated II Tempo control data 
by said thing [ writing a part in said storage means as PERT's II Tempo control data ] 
in invention of claim 24. 

[0011] Invention of claim 7 is equipped with an actuation means to output the 
actuation data according to actuation of a user, in invention of claims 1-6. The 
aforementioned read-out control means Correction data are generated based on the 
actuation data which the actuation means outputted, the II Tempo control data for 
said every network is corrected by this correction data, and it is characterized by 
controlling read-out II Tempo of time series data according to said each network 
based on this corrected II Tempo control data. Invention of claim 15 is equipped with 
an actuation means to output the actuation data according to actuation of a user, in 
invention of claims 9-14. Said performance control means Correction data are 
generated based on the actuation data which the actuation means outputted, the II 
Tempo control data for said every PERT is corrected by this correction data, and it is 
characterized by controlling read-out II Tempo of performance data according to said 
each PERT based on this corrected II Tempo control data. 

[0012] Invention of claim 26 is equipped with an actuation means to output the 
actuation data according to actuation of a user, in invention of claims 20-25. Said 
performance control means Correction data are generated based on the actuation 
data which the actuation means outputted, the II Tempo control data for said every 
network is corrected by this correction data, and it is characterized by controlling 
read-out II Tempo of image data according to said each network based on this 
corrected II Tempo control data. 

[0013] Invention of claim 8 is characterized by equipping said actuation means with a 
sensor means to exercise with the body and to detect the movement mode or a 
posture condition, and an actuation data output means to generate actuation data 
based on the contents of detection of this sensor means in invention of claims 3-7. 
Invention of claim 16 is characterized by equipping said actuation means with a sensor 
means to exercise with the body and to detect the movement mode or a posture 
condition, and an actuation data output means to generate actuation data based on 
the contents of detection of this sensor means in invention of claims 11-15. Invention 
of claim 27 is characterized by equipping said actuation means with a sensor means to 
exercise with the body and to detect the movement mode or a posture condition, and 
an actuation data output means to generate actuation data based on the contents of 
detection of this sensor means in invention of claims 22-26. 

[0014] Invention of claim 1 7 is characterized by said performance data being 



sequence data which consist of read-out timing of event data and these event data in 
invention of claims 9-16. Invention of claim 18 is characterized by said performance 
data being a data point of the time series which recorded the performance sound in 
invention of claims 9-16. 

[0015] Although this invention is applicable to all two or more time series data besides 
multiple part's performance data and two or more image data which display a 
respectively different image, below, multiple part's performance data are mentioned as 
an example, and it mainly explains them. When reading and performing multiple part's 
performance data, based on the II Tempo control data for every PERT, read-out II 
Tempo of performance data is controlled. By controlling read-out II Tempo of an 
automatic performance, i.e., II Tempo of a performance, by the II Tempo control data 
for every PERT, each PERT can be performed with a respectively original feeling of II 
Tempo (pronunciation timing, silence timing), and the performance based on multiple 
part's music data (automatic) can be made into what was rich in change like a real 
concert. If this is applied, other data, for example, image data, two or more images can 
be expressed as a respectively separate feeling of II Tempo. For example, control of 
displaying the image with which two or more musical instruments are played according 
to performance II Tempo of each musical instrument is attained. 

[0016] Moreover, in this invention, the automatic performance of the performance 
which was rich in the above-mentioned change can be carried out by memorizing the II 
Tempo control data for every above-mentioned PERT for the storage means with the 
above-mentioned performance data. 

[001 7] Moreover, in this invention, by generating the II Tempo control data assigned to 
each PERT using the actuation means which a user operates, each PERT's II Tempo 
control can be opened to a user (other performance elements, such as a pitch and a 
rhythm, using the thing of performance data), and a user can participate in concert by 
easy actuation, and can lower the threshold of a music performance, in this case, all 
PERT's read-out II Tempo — an actuation means — you may control — a part — 
only PERT's read-out II Tempo may be controlled by the actuation means, and the II 
Tempo control data memorized by the storage means may perform other PERT's 
read-out II Tempo. 

[0018] Moreover, in this invention, the II Tempo control data generated based on 
actuation (actuation data) of an actuation means is written in a storage means. When 
applicable PERT's II Tempo control data is already memorized, you may make it 
rewrite and correct the II Tempo control data. 

[0019] One PERT's II Tempo is controlled by the II Tempo control data which was 
generated with one actuation means in the above-mentioned case (other PERT 
controlling by the II Tempo control data of a storage means). It enables him for one 
user to control all PERT's II Tempo, and to save the music data by carrying out 
repeatedly, switching the PERT who assigns an actuation means for performance of 



writing the generated II Tempo control data in a storage means. 

[0020] Moreover, even if each PERT's user does not happen to be at coincidence at 
one place by transmitting and receiving the music data which wrote in some II Tempo 
control data through a network, each user can write in PERT's II Tempo control data 
with which reception and a him take charge of music data from other users through a 
network, and can transmit music data to the next user further, and the simulation of 
concert through a network becomes possible. 

[0021] Moreover, in this invention, when performing the music data which have 
multiple part's performance data and the II Tempo control data for every PERT, the II 
Tempo control data for every above-mentioned PERT is corrected by the correction 
data generated based on actuation (actuation data) of an actuation means. The 
method of correction can apply the method with which correction data are corrected 
to the same ratio for the II Tempo control data for every PERT by the division or 
carrying out multiplication, or only the same value fluctuates the II Tempo control data 
for every PERT by adding or subtracting correction data, this corrected II Tempo 
control data for every PERT — each PERT — by controlling read-out II Tempo of 
performance data separately, the II Tempo control of all PERT coincidence is attained, 
with the relation of II Tempo between each PERT maintained. 

[0022] In addition, although the usual performance operating sets, such as a keyboard, 
can also be used as an II Tempo control device which a user operates, it is also 
controllable using the equipment which detects the movement mode and posture 
condition of the body of a user, and while being able to lower the threshold of 
performance participation more by using such equipment, the natural II Tempo control 
is attained. 

[0023] Furthermore, as performance data, any of the data point which recorded 
performance sounds, such as sequence data, such as MIDI, PCM data, and MP3 data, 
can also be used. In addition, the PERT in this invention can make a MIDI channel 
correspond in the case of sequence data, and when it is a data point, he can make a 
truck correspond. 
[0024] 

[Embodiment of the Invention] With reference to a drawing, the automatic 
performance control unit which is the operation gestalt of this invention is explained. 
Drawing 1 is the block diagram of this automatic performance control device. This 
automatic performance control unit may be a dedicated device although it is made to 
realize on a personal computer by operating software. 

[0025] In drawing 1 , ROM42, RAM43, large capacity storage 44, the MIDI interface 45, 
the USB interface 46, the keyboard 47, the pointing device 48, the display 49, and the 
communication interface 50 are connected to CPU41 which controls the whole 
equipment through the bus. Moreover, the sound-source equipment 4 which is an 
external device is connected to the MIDI interface 45. 



[0026] The bootstrap etc. is memorized by ROM42. Large capacity storage 44 
consists of a hard disk, a CD-ROM, MO, etc., and a system program, an application 
program, music data, etc. are memorized. After a personal computer 3 starts at the 
startup time, a system program, an application program, etc. are read into RAM43 from 
large capacity storage 44. Moreover, a storage area required at the time of application 
program activation is secured to RAM43. From the USB interface 46, the actuation 
data for controlling an automatic performance by actuation of a user (user control) 
are inputted. Choosing the music to perform etc. uses a keyboard 47 and a pointing 
device 48, when a user operates an application program. A communication interface 
50 is an interface for communicating with server equipment (un-illustrating) or other 
automatic performance control devices through a telephone line or the Internet, and 
music data can be downloaded from these servers equipment or other automatic 
performance control devices, or it can transmit the music data memorized to this 
automatic performance control device. The music data downloaded from server 
equipment or other automatic performance control devices are memorized by RAM43 
or large capacity storage 44. 

[0027] The sound-source equipment 4 connected to the MIDI interface 45 gives 
effects, such as an echo, to the generated musical sound while generating musical 
sound based on the performance data (MIDI data) inputted from the personal 
computer 3. And this musical sound is outputted to amplifier 5. Amplifier 5 amplifies 
this musical sound and outputs it to a loudspeaker 6. A loudspeaker 6 makes this 
musical sound sound, and carries out sound emission. In addition, sound-source 
equipment 4 may be what may form a musical-sound wave by what kind of method, 
and can choose the method according to the class of sounds, such as a 
self-sustaining sound and an attenuation sound. 

[0028] This automatic performance control device 3 memorizes the music data which 
consist of multiple part, and carries out the automatic performance of this. Each 
PERT has the II Tempo control data tracks for controlling its PERT's besides the 
performance data tracks for pronouncing the PERT's musical sound original II Tempo, 
and the II Tempo setup and the II Tempo control which became independent of other 
PERT are attained. Moreover, the score data tracks in which the score indicative data 
was written are also prepared for every truck, by reading the data of this truck by 
set-up II Tempo, advance of music can be followed and a score can be displayed on a 
display 49. 

[0029] Drawing 2 is drawing showing the configuration of the music data memorized by 
the above-mentioned large capacity storage 44. This music data consists of multiple 
part. In the case of MIDI data, each PERT corresponds to a different MIDI channel, 
respectively. Each PERT consists of image data tracks in which the image data which 
are data for displaying the performance data tracks in which the read-out timing of 
event data, such as a pronunciation event of musical sound and a silence event, and 



the event data of those was written, the II Tempo control data tracks in which this 
PERT's original II Tempo control data was written, and this PERT's image were written. 
The above-mentioned II Tempo control data tracks and score data tracks also consist 
of a data stream of the II Tempo control data which is event data, and the timing data 
in which the timing which reads image data and its event data is shown. 
[0030] In addition, as image data memorized by image data tracks, the animation data 
of the player who plays the PERT's score data and the PERT's musical instrument, for 
example etc. can be used. When score data are applied as image data, the display of a 
score comes to be updated according to the PERT's performance II Tempo. The 
example of a display of score data is shown in drawing 10 . Moreover, when animation 
data are used as image data, a player's animation can move according to II Tempo of a 
performance of the PERT, and an image as if it was performing the PERT can be 
displayed. The example of a display of animation data is shown in drawing 11 . 
Moreover, two or more image data, such as score data, animation data, and other data, 
may be used in parallel. 

[0031] Furthermore, independently of each PERT, the criteria II Tempo data tracks in 
which II Tempo used as the criteria of this whole music data was written are prepared. 
The criteria II Tempo data which are event data of this truck are used as data for 
reference, when a user controls all PERT's II Tempo collectively. About processing 
actuation in case a user controls all PERT's II Tempo collectively, it mentions later. 
[0032] When carrying out an entire automatic performance without a user's doing II 
Tempo control by the manual, CPU41 advances an automatic performance of each 
PERT by II Tempo set up by the above-mentioned II Tempo control data tracks. On 
the other hand, when user control of some (or whole) PERT is carried out, not using 
the II Tempo control data of the PERT's II Tempo control data tracks, an automatic 
performance of the PERT is controlled based on the II Tempo control data deduced 
based on the actuation data inputted from the actuation unit which a user operates. 
Even in this case, about the PERT who does not do user control of II Tempo, II Tempo 
is controlled based on the II Tempo control data of the II Tempo control data tracks. 
[0033] Moreover, when a user controls all PERT's II Tempo collectively, the II Tempo 
control data deduced based on the actuation data inputted from the actuation unit 
which a user operates is compared with criteria II Tempo of the timing of criteria II 
Tempo data tracks, and all PERT's II Tempo is controlled by making the ratio reflect in 
II Tempo of an automatic performance of each PERT. 

[0034] Drawing 3 is drawing showing the configuration of the performance control 
system containing the above-mentioned automatic performance control unit 3. This 
performance control system has the hand controller 1 which is an actuation unit, the 
communication link unit 2, a personal computer 3, sound-source equipment 4, 
amplifier 5, and a loudspeaker 6. The above-mentioned hand controller 1 can control 
predetermined PERT's II Tempo at the time of an automatic performance, when a user 



does rocking actuation and does rocking actuation by predetermined II Tempo. This 
performance control system can be equipped with two or more hand controllers 1, and 
a respectively separate ID number (= 1-24) is set to each hand controller 1 in that 
case. The hand controller 1 has the configuration of a baton form, as shown in drawing 
4 , and a user does rocking actuation. The acceleration sensor 1 7 (refer to drawing 4 ) 
of built-in of the acceleration by this rocking actuation detects, and wireless 
transmission of this acceleration data is carried out from the hand controller 1 as 
actuation data at the communication link unit 2. The communication link unit 2 
receives the actuation data by which wireless transmission is carried out from the 
hand controller 1, and transmits this to the personal computer 3 which is an automatic 
performance control unit. A personal computer 3 generates the II Tempo control data 
based on the inputted actuation data, and controls II Tempo of an automatic 
performance of the PERT to whom this hand controller 1 is assigned based on this II 
Tempo control data. Sound-source equipment 4 controls the pronunciation/silence of 
musical sound based on the performance data inputted from the automatic 
performance control device. 

[0035] If a user does rocking actuation of the above-mentioned hand controller 1, the 
automatic performance control unit 3 will detect II Tempo (spacing at which a rocking 
peak is detected) of rocking, and will generate the II Tempo control data of an 
automatic performance based on this II Tempo. Moreover, based on the magnitude of 
the acceleration (or rate) of rocking, sound volume is also controllable. Thus, a user 
enables it to control only II Tempo (and sound volume) of an automatic performance, 
and a user can be made to do performance participation of other performance 
elements (a pitch, sound length, etc.) simple by having enabled it to control based on 
music data. 

[0036] Drawing 4 is the external view of the hand controller 1 which is the 
above-mentioned actuation unit. The hand controller 1 has the baton form where the 
center section became thin, and a case can be divided into the top case 10 and the 
bottom case 1 1 bordering on the center which is the thinnest. The code-like antenna 
18 is pulled out from the pars basilaris ossis occipitalis of the bottom case 11. The 
circuit board 13 in which the below-mentioned receiving circuit, CPU, the switch 
group, etc. were mounted is formed in the interior. The acceleration sensor 1 7 of 7 
segment drop 16 of 14 (14a-14d) or double figures LED of four colors and three shafts 
etc. is mounted in the top case 10 side of the circuit board 13. LED 14a, 14b, 14c, and 
14d is LED of blue luminescence, green luminescence, and red luminescence and 
orange light emitting, respectively. 

[0037] If this hand controller 1 is made to rock, an acceleration sensor 17 will detect 
that rocking acceleration, and will transmit to the communication link unit 2 by making 
this into actuation data. The communication link unit 2 receives this actuation data, 
and inputs this actuation data into the automatic (minding USB interface) 



performance control device 3. 

[0038] Drawing 5 is the block diagram of the control section of the hand controller 1. 
The control section 20 consists of microcomputers which contained CPU, memory, an 
interface, etc. in one chip, and controls actuation of this hand controller 1. The 
acceleration sensor 17 of three shafts, the ID configuration switch 21, the modem 23, 
the modulation circuit 24, the LED display circuit 22, etc. are connected to this 
control section 20. 

[0039] An acceleration sensor 17 is a semi-conductor sensor, can answer the 
sampling frequency of about 400Hz, and uses that whose resolution is about 8 bits. If 
an acceleration sensor 17 rocks with rocking of the hand controller 1, 8-bit 
acceleration data will be outputted about X shaft orientations, Y shaft orientations, 
and each Z shaft orientations. The acceleration sensor 17 is built in the point of the 
hand controller 1 so that the X-axis, a Y-axis, and the Z-axis may become in the 
direction shown in drawing 4 . In addition, this acceleration sensor 17 may not be 
limited to 3 shaft sensor, and may be a biaxial sensor and the sensor of the 
non-direction. 

[0040] The ID configuration switch 21 is a 5-bit DIP switch, and can set up the ID 
number of 1-24. This ID configuration switch 21 is mounted on the circuit board 13 by 
the side of the bottom case 11, and extracts and operates the circuit board 13 from 
the bottom case 11. A control section 20 is outputted to a modem 23 by using as 
actuation data the acceleration data inputted from the acceleration sensor 17. The ID 
number set up by the ID configuration switch 21 is added to this actuation data. 
[0041] A modem 23 is a circuit which changes into phase transition data the baseband 
data inputted from the control section 20. A modulation circuit 24 is a circuit which 
carries out a GMSK modulation and makes possible the radio transmission of the 
carrier signal of a 2.4GHz band by the above-mentioned phase transition data. With 
the transmitting output amplifier 25, the signal of the 2.4GHz band outputted from the 
modulation circuit 24 is amplified by feeble power extent, and a radiation output is 
carried out from an antenna 18. In addition, the data transmission to a communication 
link unit from a hand controller can apply the short-distance wireless interface using 
frequency diffusion communication modes using a USB interface besides the radio 
transmission of a signal by which FM modulation was carried out in this way etc., such 
as a cable transmission and Bluetooth, etc. 

[0042] Drawing 6 - drawing 9 are flow charts which show actuation of the 
above-mentioned automatic performance control device. Drawing 6 is a flow chart 
which shows the automatic performance setting-operation which sets up the music 
and PERT who do an automatic performance. This drawing (A) is a flow chart which 
shows the Maine actuation. If the song selection input of the music a user wants to 
operate a keyboard 47 or a pointing device 48, and to carry out an automatic 
performance is carried out (s1), the music data corresponding to this song selection 



will be read from large capacity storage 44 to RAM43 (s2). When the music which is 
not memorized by large capacity storage 44 selects a song, you may make it download 
from a server or other automatic performance control units through a communication 
interface 50. An automatic performance is started in the mode (automatic control or 
user control) in which performed PERT selection actuation of which PERT to perform 
among multiple part after this (s3), and the selected PERT was chosen (s4). 
[0043] This drawing (B) is a flow chart which shows PERT selection actuation. A user 
operates a keyboard 47 or a pointing device 48, and chooses performance PERT (s5). 
Choosing multiple part according to an individual can also bundle up all PERT, and 
performance PERT's selection can also be chosen. While setting up so that the 
automatic performance of (s6) and all the PERT may be carried out when is 
collectively chosen by all PERT (s7), it judges [ which controls all PERTs II Tempo 
collectively together with all the above-mentioned PERT's selection ] whether purport 
selection was made (s8). When that is chosen, the return of the whole II Tempo 
control is set up and carried out (s9). 

[0044] The input of an or [ it carries out user control of whether when PERT is chosen 
according to an individual, II Tempo of (s6) and the PERT of those is controlled 
automatically (user control mode) (automatic II Tempo control mode) ] is received 
(s10). In carrying out user control, it also receives the input of whether to record the II 
Tempo control data which assigned which hand controller 1 to this PERT, or was 
generated by user control. What is necessary is just to perform assignment of a hand 
controller by matching ID of a predetermined hand controller with the PERT. 
[0045] When the automatic II Tempo control mode is chosen by s10, the purport which 
carries out automatic II Tempo control of this PERT is set up (s12), and it progresses 
to s16. On the other hand, when the user control mode is chosen by s10, the purport 
which carries out user control of the PERT is set up. Furthermore, when it is chosen 
so that the II Tempo control data of this user control may be recorded, it sets up so 
that (s14) and this II Tempo control data may be written in the II Tempo control data 
tracks of the PERT concerned (s15), and it progresses to s16. In s16, the next input is 
received, and when the selection input of the next PERT is carried out, it returns to 
s10. A return is carried out when there is an input of the purport which PERT's 
selection ended (s17). 

[0046] Drawing 7 is a flow chart which shows automatic performance control action 
and display-control actuation. This actuation is performed for each [ an automatic 
performance is carried out ] PERT of every. This drawing (A) is a flow chart which 
shows the automatic performance control action performed based on performance 
data tracks. When the II Tempo control data is received, (s20) and the received II 
Tempo control data are set up as II Tempo of this automatic performance (s21). In the 
case of the automatic II Tempo control mode, the II Tempo control data is transmitted 
from the read-out processing actuation of the II Tempo control data tracks shown in 



drawing 8 . On the other hand, in the case of the user control mode, it is transmitted 
from the actuation data-processing actuation shown in drawing 9 (B) (inputted from 
the hand controller). 

[0047] An automatic performance clock is counted up by this set-up II Tempo (s22), 
when it becomes the read-out timing of the following event data based on timing data, 
(s23) and the following event data (performance data) are read (s24), and this 
performance data is transmitted to sound-source equipment 4. As performance data, 
there are pronunciation data, above-mentioned silence data, above-mentioned 
effectiveness control data, etc. And the return of the timing data which direct the 
read-out timing of the following event is set and (s25) carried out. This actuation is 
repeatedly performed until music is completed. 

[0048] This drawing (B) is a flow chart which shows the display-control actuation 
performed based on image data tracks. When the II Tempo control data is received, 
(s27) and the received II Tempo control data are set up as II Tempo of this display 
control (s28). In the case of the automatic II Tempo control mode, the II Tempo 
control data is transmitted like the above-mentioned automatic performance control 
action from the read-out processing actuation of the II Tempo control data tracks 
shown in drawing 8 . On the other hand, in the case of the user control mode, it is 
transmitted from the actuation data-processing actuation shown in drawing 9 (B) 
(inputted from the hand controller). 

[0049] A display-control clock is counted up by this set-up II Tempo (s29), based on 
timing data, when it becomes the read-out timing of the following event data, (s30) 
and the following event data (image data) are read (s31), and the image based on this 
image data is displayed on a display 49. 

[0050] When image data are score data (code data), the image pattern of the score 
corresponding to this code is read from a pattern library (font), an image is created, 
and this is outputted to a display 49. On the other hand, in the case of animation data, 
the frame of the animation is read out of music data, and it displays on a display 49. In 
addition, even if it is animation, in compounding a player combining a graphic form 
material, image data are code data which direct the combination of the graphic form 
material. In this case, a graphic form material is read from a graphic form material 
library like score data, one frame of animation is created combining this, and it outputs 
to a display 49. In addition, a pattern is constituted so that the image of the multiple 
part by whom it is then performed [ in score data ] also in animation may be displayed 
on one screen. 

[0051] The timing data which direct the read-out timing of the following event this the 
back are set (s32). And in the case of the user control mode, it judges whether this 
PERT is the user control mode (s33), and II Tempo by which a current setup is carried 
out with the II Tempo control data currently written in the II Tempo control data 
tracks is compared, and this comparison result is displayed under that score (s35). 



(when the score is displayed) The above actuation is repeatedly performed until music 
is completed. 

[0052] The example of a display of a score is shown in drawing 10 . Thus, graphical 
representation of II Tempo of the II Tempo control data tracks and II Tempo of user 
control is carried out to the lower part of a score, and whenever [ flattery ] is known. 
Moreover, the example of a display of animation is shown in drawing 1 1 . Although this 
drawing is the animation of a band performance, it changes like drawing 12 based on 
the image data with which each player s animation was read from image data tracks 
according to that PERT's II Tempo (advance of a performance). 

[0053] Drawing 8 is a flow chart which shows each PERT's automatic II Tempo control 
action. When a clock is counted up by II Tempo set up in actuation of it (s40) and it 
becomes the read-out timing of the following event data based on timing data, while 
reading (s41) and the following event data (II Tempo control data) (s42) and setting 
this II Tempo control data as actuation of one, it transmits to automatic performance 
control action and display-control actuation (s43). And the return of the timing data 
which direct the read-out timing of the following event is set and (s44) carried out. 
This actuation is repeatedly performed until music is completed. 
[0054] On the other hand, when the II Tempo control information is received from 
whole II Tempo control action, while correcting the current II Tempo control data 
according to this (s46) and setting this corrected II Tempo control data as actuation 
of one, it transmits to automatic performance control action and display-control 
actuation (s47). 

[0055] This whole II Tempo control information is transmitted from the whole II Tempo 
control action shown in this drawing (B), and this whole II Tempo control action is 
performed when controlling whole II Tempo, carrying out the automatic performance 
of each PERT. 

[0056] In this drawing (B), when [ which controls all PERT's II Tempo collectively ] 
purport selection is made, this actuation is performed, while choosing so that a user 
may perform all PERT in actuation of drawing 6 (B). If the II Tempo control data 
generated and inputted when a user operated an actuation unit (hand controller) is 
inputted (s50), this II Tempo control data will be compared with the criteria II Tempo 
data currently written in the criteria II Tempo truck, and let this ratio be fix information 
text (s51). For example, the inputted II Tempo control data is 120, and when criteria II 
Tempo data are 100, the contents of fix information text are set to 1.2. Here, the 
criteria II Tempo truck is read one by one with the II Tempo control data generated by 
actuation of the above-mentioned actuation unit. And s51 compares the II Tempo 
control data inputted as the newest criteria II Tempo data by which current reading 
appearance is carried out. The fix information text computed by the above-mentioned 
processing is transmitted to actuation of each PERT (s52). In addition, the calculation 
approach of fix information text may subtract and compute the II Tempo control data 



by criteria II Tempo data in addition to the approach of computing it by criteria II 
Tempo data by doing the division of the II Tempo control data inputted as mentioned 
above. Moreover, the table which reads fix information text from the II Tempo control 
data and criteria II Tempo data may be prepared, and you may replace with the 
above-mentioned operation. 

[0057] Drawing 9 is a flow chart which shows the actuation data send action of the 
hand controller 1 which is the above-mentioned actuation unit, and actuation 
data-processing actuation of an automatic performance control device. 
[0058] This drawing (A) is a flow chart which shows actuation of the control section 
20 of the hand controller 1. A power source is turned on, it is not rich and initialization 
actuation of reset of each chip etc. is performed (s60). If actuation becomes possible 
by this initialization actuation, X, Y, and the rocking acceleration of three shafts of a Z 
direction will be detected (s61), this will be edited into the wording of a telegram of 
actuation data (s62), and it will transmit to the automatic performance control unit 3 
(communication link unit 2) (s63). And lighting control of the LED is carried out 
according to this rocking acceleration (s64). This actuation is performed every 2.5ms. 
Thus, the above-mentioned actuation is performed every 2.5ms, and rocking actuation 
of a user is detectable with high resolution, removing a fine oscillating noise by 
detecting the acceleration of the X-axis, a Y-axis, and the Z-axis with the resolution 
for about 2.5ms. 

[0059] The mode of lighting control of LED 14a-14d is as follows. When the 
acceleration of the direction of + of X shaft orientations is more than fixed, LED14a of 
blue luminescence is turned on. When the acceleration of the direction of - of X shaft 
orientations is more than fixed, LED14b of green luminescence is turned on. When the 
acceleration of the direction of + of Y shaft orientations is more than fixed, LED14c of 
red luminescence is turned on. When the acceleration of the direction of - of Y shaft 
orientations is more than fixed, LED14d of orange luminescence is turned on. 
Moreover, when the acceleration of the direction of + of Z shaft orientations is more 
than fixed, LED14a and LED14b are turned on to coincidence. When the acceleration 
of the direction of - of Z shaft orientations is more than fixed, LED14c and LED14d 
are turned on to coincidence. Moreover, you may make it turn on LED 14a-14d with 
the quantity of light according to the magnitude of rocking acceleration in the 
above-mentioned lighting control. 

[0060] In addition, when two or more hand controllers 1 are used, the 
above-mentioned actuation will be performed for every hand controller, and actuation 
data will be inputted into the automatic performance control device 3 from two or 
more hand controllers 1, respectively. 

[0061] Drawing 9 (B) is a flow chart which shows actuation data-processing actuation 
of the automatic performance control device 3. This actuation is actuation which 
generates the II Tempo control data based on the actuation data inputted from the 



hand controller 1 through the communication link unit 2. When two or more hand 
controllers 1 control separate PERT, this actuation is performed for every hand 
controller. An input of actuation data detects rocking acceleration based on this 
actuation data (s71). (s70) Rocking acceleration is the acceleration vector which 
compounded X shaft-orientations acceleration, Y shaft-orientations acceleration, and 
Z shaft-orientations acceleration. Change of this magnitude of a vector and a 
direction detects whether it is a local peak (s72). When a local peak is not detected, it 
returns from s73 to s70 as it is. When a local peak is detected, II Tempo of rocking is 
deduced according to spacing with the local peak of (s73) and last time (or the past 
several times) (s74), and it transmits to the automatic performance control action and 
display-control actuation which edit this into the II Tempo control data, and 
correspond (s75). And in the case of the rewriting mode which rewrites the II Tempo 
control data tracks of the PERT who corresponds with the II Tempo control data 
generated by this user control, the data of the II Tempo control data tracks of (s76) 
and the PERT corresponding to the above are rewritten now (s77). A user's contents 
of actuation are recordable on music data with actuation in this rewriting mode. 
[0062] In addition, although he is trying to control only II Tempo of an automatic 
performance by the above-mentioned operation gestalt by the hand controller 1, 
sound-volume control, control of pronunciation timing, control of a tone, etc. can be 
performed in addition to this. Control of pronunciation timing is control of detecting 
the peak point of for example, rocking acceleration, and making musical sound 
pronounce to the timing of this peak point etc. Moreover, control of a tone is control 
of changing musical sound to a soft tone or a hard tone according to the rate of 
change of for example, rocking acceleration, or a change wave. 

[0063] In addition, although one hand controller 1 and one PERT correspond by 1 to 1, 
correspondence relation is not limited to 1 to 1, but you may make it assign two or 
more trucks to one hand controller, and may make it control one PERT by the 
above-mentioned user control mode by two or more hand controllers. 
[0064] When controlling one truck by two or more hand controllers, based on the 
actuation data inputted from each hand controller, the comprehensive data for every 
above-mentioned PERT are deduced, and it is made to perform the PERT's (truck of 
music data) performance control based on this. 

[0065] In addition, although he is trying to pronounce all multiple part's (two or more 
tones) musical sound with one sound-source equipment 4, two or more sound-source 
equipments (musical instrument) are connected to the automatic performance control 
unit 3 which is a control unit, and you may make it assign the sound source according 
to individual (musical instrument) to each PERT (all or part) with the above-mentioned 
operation gestalt, respectively, drawing 13 — the automatic performance control unit 
3 — a MIDI interface — minding — usual sound-source equipment 4, the 
sound-source equipment 60 for electron tube musical instruments, electronic drum 



sound-source equipment 61, and electromagnetism — the example which connected 
the drive piano 62 and the electronic violin 63 is shown, and it takes charge of two or 
more PERT, respectively to sound-source equipment 4 and the sound-source 
equipment 60 for electron tube musical instruments — making — electromagnetism 
— the drive piano 62 is made to take charge only of piano PERT For example, as 
sound-source equipment 4, the FM sound of a fundamental-wave compositive type 
etc. is applied, and various musical sound can be generated general-purpose. The 
physical model sound source which simulated the actual wind instrument in software 
by the processor as sound-source equipment 60 for electron tube musical 
instruments is applied. The PCM tone generator from which electronic drum 
sound-source equipment 61 reads a percussion instrument sound by single shot is 
applied, moreover, electromagnetism — the drive piano 62 is a piano by which the 
solenoid was connected to each hammer, and is the natural musical instrument which 
can drive a solenoid by performance data, such as MIDI data. Furthermore, the 
electronic violin 63 is the electrohone of violin molds, such as for example, a silence 
violin (trademark), and contains the sound-source equipment in which the sound of a 
stringed instrument specialized. 

[0066] Thus, it is also possible to connect the sound-source equipment which 
generates the natural musical sound which a sound source connectable with a 
personal computer 3 is not limited to an electronic sound source, but is driven 
electrically. In addition, since time difference (time lag) until it is actually pronounced 
differs after performance data are inputted according to the class of sound source, 
when connecting two or more kinds of sound sources, a delay means to compensate 
this time lag is formed in the preceding paragraph of sound-source equipment, and the 
performance data of the same timing are pronounced by the same timing. 
[0067] Furthermore, since sound-source equipment and electrohone which have a 
USB interface are also put in practical use, an electric piano 64, an electronic organ 
65, the electronic drum 66, etc. are connected to the automatic performance control 
device 3 through a USB interface like illustration, performance data are outputted 
from a USB interface, and you may make it drive the above-mentioned electrohone 
(sound-source equipment) in recent years. 

[0068] Thus, also visually by connecting two or more sound sources of a 
pronunciation gestalt different, respectively, ensemble-concert is attained also in 
acoustic sense. 

[0069] Moreover, although a user has the above-mentioned operation gestalt in a 
hand as an actuation unit and the hand controller 1 which carries out rocking 
actuation is used, an actuation unit is not limited to a hand controller. For example, it 
is also possible for an acceleration sensor to be built in the microphone for a song, and 
for it to be able to be made to mix song and automatic performance control. If this 
hand controller built-in microphone is applied to karaoke equipment, it will become 



possible to sing controlling performance II Tempo to II Tempo can control that karaoke 
music while a song person sings, for example, he wants to sing a song person to. 
Moreover, it is also possible to use the tap switch which is not limited to what carries 
out rocking actuation as an actuation unit, but detects the strength of the press with 
a finger. This tap switch can consist of piezo-electric sensors etc. 
[0070] Moreover, as shown in drawing 14 , shoes are made into the actuation unit 50, 
3 shaft acceleration sensor 51 is embedded on the heel, actuation of the kick which 
moves a guide peg forward and backward, the actuation shaken at right and left, and 
the actuation which is moved up and down and to complete are detected, and you may 
make it control the pronunciation of musical sound based on this. 
[0071] Moreover, as shown in the drawing 15 upper part, the fingertip actuation unit 
52 which has the acceleration sensor 53 of three shafts in a user's fingertip is 
attached, a motion of the three dimension of a finger is detected, and the 
pronunciation of musical sound can be controlled. In this case, it is also possible by 
attaching a separate sensor in each finger to control a different musical sound for 
every finger. 

[0072] Moreover, in addition to rocking of an arm, a pulse is also detectable by 
attaching the wrist actuation unit 54 which has the three-dimension acceleration 
sensor 55 and the pulse sensor 56 at a wrist as shown in this drawing lower part. In 
this case, it also becomes possible by attaching a wrist handler in both wrists to 
control two musical sound by both arms. 

[0073] Moreover, although not illustrated, it is also possible to attach the same 
handler as a user's ankle and drum. Furthermore, although he is trying to control a 
performance by the above-mentioned operation gestalt based on the actuation a user 
makes [ actuation ] the hand controller 1 rock [ actuation ], you may make it control a 
performance based on a user's static posture. 

[0074] In addition, in the above-mentioned operation gestalt, in the user operation 
mode and rewriting mode, the automatic performance of the music data with which 
predetermined PERT's II Tempo control data tracks were rewritten is carried out 
again, it is rewriting other PERT's II Tempo control data shortly, and one user can also 
rewrite all PERT's II Tempo control data tracks one by one using one actuation unit. 
Moreover, by transmitting and receiving music data through a network, others perform 
the music data with which a part of them rewrote PERT, or the concert simulation of 
carrying out the automatic performance of the music data with which a part of others 
rewrote PERT while carrying out user control of other PERT also becomes possible. 
[0075] Although what the above-mentioned operation gestalt is an automatic 
performance control unit, and can display an image together was shown, that in which 
only an image carries out II Tempo control without performing music is also contained 
in this invention. For example, picture reproducer is connected to the sports 
equipment which pedals a bicycle mold, and it may be made to advance the image of 



scenery by II Tempo which rows a pedal. In this case, the number of images may be 
[ two or more ], and a single network is sufficient as them. 

[0076] Moreover, if there is equipment which reads out text data as equipment which 
reads time series data other than a performance and an image and this invention is 
applied, a text reads out and it can make it possible to control II Tempo by actuation 
of a user. 
[0077] 

[Effect of the Invention] Since II Tempo control of read-out II Tempo of two or more 
time series data can be carried out as mentioned above with the II Tempo control data 
which became independent, respectively at the time of read-out of time series data 
according to this invention, playback etc. can be controlled for every network and 
read-out of the time series data which were rich in change becomes possible. 
[0078] If this is applied to a performance control device, since II Tempo control of 
each of multiple part can be carried out with the independent II Tempo control data at 
the time of a performance, pronunciation, silence, etc. can be freely controlled for 
every PERT, and the performance of concert which was rich in change is attained. 
Moreover, in this case, a pitch, sound length, etc. of a performance of this PERT are 
controlled by opening PERT's II Tempo control to a user in part based on performance 
data, and since a user should control only this PERT's II Tempo, he can participate in 
a concert performance easily and can lower the threshold of a music performance. 
[0079] Moreover, a performance of a user can be recorded into music data by writing 
the II Tempo control data generated based on actuation of the actuation means by the 
user in a storage means with performance data, and it also becomes possible to 
control II Tempo of the PERT of further others by performing this music data again 
according to this performance, while its performance is reproducible. Moreover, this 
data is transmitted to other users through a network, and it also becomes possible to 
carry out concert simulation. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The block diagram of the automatic performance control device which is 
the operation gestalt of this invention 

[Drawing 2] Drawing showing the configuration of the automatic performance data 
used with this automatic performance control device 

[Drawing 3] The outline block diagram of the performance control system containing 
the above-mentioned automatic performance control unit 

[Drawing 4] The external view of the hand controller which is the actuation unit of this 



performance control system 

[Drawing 5] The block diagram of this hand controller 

[Drawing 6] The flow chart which shows actuation of the above-mentioned automatic 
performance control device 

[Drawing 7] The flow chart which shows actuation of the above-mentioned automatic 
performance control device 

[Drawing 8] The flow chart which shows actuation of the above-mentioned automatic 
performance control device 

[Drawing 9] The flow chart which shows actuation of the above-mentioned automatic 
performance control device and a hand controller 

[Drawing 10] Drawing showing the example of a score display of the above-mentioned 
automatic performance control unit 

[Drawing 1 1] Drawing showing the example of an animation display of the 
above-mentioned automatic performance control unit 

[Drawing 12] Drawing showing the example of an animation display of the 
above-mentioned automatic performance control unit 

[Drawing 13] Drawing showing other examples of a configuration of a performance 
control system 

[Drawing 14] Drawing showing other modes of an actuation unit 
[Drawing 15] Drawing showing other modes of an actuation unit 
[Description of Notations] 

1 [ — Sound-source equipment, 14a - 14 d — LED, 16 / — 7 segment drop, 17 / — 3 
shaft acceleration sensor ] — A hand controller (actuation unit), 2 — A 
communication link unit, 3 — An automatic performance control unit (personal 
computer), 4 
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jH*J»7*-**fBS , rs«k33!K*n/'=»^fi:{i (s l 

4) , z.<D7r>#%m : r— 2*mw^—v<07-y#%m 

^-ZY^vZKmZihtS&oKmM^X (s 1 5) , 
s 1 6fc)ity 0 s 1 QX\,l£k<DXtllt&tfWL »^ 
-F^^A73^n/c^-&(ctis l OfcMSo ><— 

(s 1 7) „ 

[0046] H7«i»is#*ij»ft^ WrMmm^n: 
s#^- F«{c^tf £ns 0 mm (a) tiM^-^h 

tea (5 2 0), SMbfcxy^sJiUx-^^cogft 

iHiOr^fcLTiStS (s 2 1) . -rV^Jftl-r 

<^o -77, a— tfSijen^E— b-nm-encit. 09 (b) 

[0 0 4 7] Z(OmM2tlfrf->#T&mffi%-!?Uyt 
*Zi<y>hT<y7L (s2 2) , ^-Y^y^x-^tca 

^w^yhf-^ <Dmta 2 7 5 > Tic a o rcti^- 
fca (s 2 3) , ^t>hf-^ (i^#x-^) 

(s2 4) , CO»#f f -^**igSB4fC3^ 
7*— ^ is «fc t«ftjRW«l-7*— ^ a E 1$3b 2> o * L T^<D 7 

F<oKm^75yy«rjg^-rs^75yy7 :t -^^ 

-b'yhLT (s2 5) , U*->f*. COliffttfltf 

m7?z£x*m t )mLnftt£n%o 
[0048] mm (b) «, ijwtf 1 -^ f^-v ^tcsc5 

So r-y^un'f-^^mhrcm'^icit (s 27) , 

TK^-rs (s 28) o T-yxmrnr-zte, ±.m&m 

it m 8 tc^-r r- >^*ijfflj-r- * f 5 y v (Dmm^mmw 
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[0 0 4 9] CO^^n/c^V^T-g^ftilJffll^P-y^ 
^*^yh7'y7"L (s29) , ?^f5> ^f- £ S 
■3*, X<D^^> F ■5*— £ Oltti ^fc * o fc» 

(s30) > ^O'T'O'hf-^ (Bfcfl!^— 
£rSr&WL (s 3 1) , il<DW«r f -^KSt3<W«* 
*^g|5 4 9fC^-f £><> 

[0 0 5 0] B^itx-^Tb^it-r'-^ (a-Kf-?) 

*—>3 ><D 1 7U~Zfc&f&ftLT&3*84 9 tcm7J~r 

[0051] coo^o^yhorcm^-r = 
ffi^-rs^f 5 y^-^tty F-r* (s3 2) . 

(s3 3) , n-— ^ijffllt- K f-^sHWW 
r- £ F 5 -v * # * ii* tit ^ 5 x>>-tf SiiJflPx- * t 

7f<?%> ( s 3 5) o &>±.<Dmmtmt>mT-?z>$;-eM9 

[0 0 5 2] ^ISOg^J^ia 1 Oic^-To dcDcfc^fC 

1 HC^-To CKDiafiMy HiS^co T^.^— ^3 

[0 0 5 3] 0 8«#/^-h©S»J-r^«iJW»lf^^ 
^T^n77^77h7-y7L (s 4 0) , 

y-r- z icm-^^o-c^ > F -r-* ©Mtti z 
fc&ofc*§-mcti (s 4 1) , W'lyhf-? (7- 

yxmrnT-z) *m&mL c s 4 2) , c©T-y#w 
w-r - * * s ftvmmc &m? s i^uc, 
ti^*itf«^iwwftff lessees (s4 3) „ 
t^o-y ^ > f o»!m * -r 5 y ?*m^T 5 * -< = y f 

r-m-yhU (s4 4) , 'J?-7t5o CCDK 



[0 0 5 4] -73. ^ft-f->Jj««!fP»ff*»6^>#*!»i 

w$fi^sfsLrc^i-g-fc«, ctncfcu,xm&<D7-y$M 

m^r—ZZmiEL (s 4 6) , (KDmiElsfcT-yXfflM 

mi^xrjmmmmmmcmmr^ u 4 7) „ 

[0055] c©£frf-v#MWWRtt» RIB (B) fc 
^-r^cx > jH»JW»f^^ 53SSM*nS tOT-fev, C 

(D^faTytfM'fflmmz, F^siMLoo^ 

[0 0 5 6] |r]B (B) tCte^T, C©«lfft±, 

#06 (b) ©ftft-e^-Ffc^-rsj^K^r 
sfcfcfetc h(09-y^-mLrmmr?>mm 
iRLrzi&&icmft2tiz a mm%timft3.=-'y h o^y 

n/cT-v^SilWx-^^ATj^nsi: (s50) , c<D 

trz (s 5 1) o rctz.is. xts^nrcT-y^mmT 1 

ZOTfeD, S^rVjKf*-** 5 1 0 0<Di§-a- 

ttfc-r VtfffflWx- ^ (c J: -p TM&M»(i] S nr V S . 
^LT, s 5 1 -Z?liSfti£#m£*iTV^«#r»a^-r 

y#7*- ^ t xfj $ titer ytfrnwr- 2 1 

icmmtZ (s 5 2) o **s, «EiEffif*BO»m7JffiH:, 

^ t?i$js l T*m-r § 77 ffiw^tc, -r yi&wm?- 

re, t- VtfSUffll-r- ^ *3 <t tf'S'^P fy^f- ^ A^«EiE 
[0 0 5 7] H9«u ±IB*f¥^---y Frj 

yhD-7i (DMftr-zmmmttiszv&mmmfflw 

[0 0 5 8] H0 (A) [iAyFnyhn-7l«W 
0152 OOKif^^-r^a— ^-v— hT'feS. WMi?*y 
£ $ -r#^- -y ^0'J-b7h4iJO^-5't7^X 
i)#*^ff-rS (s6 0) o C04'--7t7l'Xi#(C 
.fc-sTl&fWnrffifCfcSfc, X, Y, Z75(6]03ttcDffi 

WAnjiS^^mb (s 6 1) , tti*»T-?oti 

tC^ALT (s6 2) , S»M#SiJfflI»H3 01«n- 
-y h 2) tC^LT^ff-r?. (s 6 3) . ^LTCOgft 
MSftCjSCTL E D^aSWSJWTS (s64)„ CO 
Klf^ti, 2. 5ms^(C||^T?n?.o COc};9tC±aB 
Wlif^Z. SmsStcUffU Xfi, Ytt, Zi<Oi)0il 
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[0059] LED14a~14d <D&'nfflW<Dtimit 
±<D»£-{C«\ fffefg^cDL ED 1 4 a*jSfftS. X 

W75f[p|C)-73fpi©)!ra)Sjg^--SJ-X±<o^(i:«s ISfeS! 

TfrQL E D 1 4 b*j£i*rrSo YS|tt7jft<7)+>7"ft<D*P5i 
S*^— SW±©«-a-{C«, ^fe^jtOL E D14cM 
■ff'T&o Ytt^|Dj©-^|6lO]taaSf* < -^W±©»^fc 
fi, tUvy'M)tOLEDl 4d^MtS. i;fc> 
ZW^|6l©+^|Bl<DijP3ijS^-^±<Dti^{C«, L E 
D 1 4 a £ L E D 1 4 b £|W]fJ#t j^TT^o Z IItS'Ip]© 
-#!pJ©An3£*#-^U:©i§£-{cy:, LED1 4cfc 
L E D 1 4 d*mmicM7ir2>o £tc ±m<D&m® 
(Cfct^T, L E D 1 4 a— 1 4 d £jgtM)Pjifi£>:*;t $ 

[0 0 6 0] &*5, W&.<D>^y KnyhD- v 1 tffflV 
hD-7 1 frZZn : €tLmft : r-2tfXij-£tiZZ tic 

[0061] 09 (b) a, um^mmmmmsnmif 

F%»rr5if-a\ c«as^yF3>hD 
-^ftfcufT^nSo aif^x-^^x^^nsi: (s7 
o) , ciDmttT-zicM-i^TnmiiQmmzmtii-tz 

(s 7 i) o ffilMm&Stextt^faibniftK, Ytfcfrftj&n 

-*;nf-^T?fes^s^*«ai"r* (s 7 2) o p- 
a (s7 3) > Mi (SfctiJSSoisiHi) <nu-tt)\>\* 
ft*ftitPftfc m^JWift^tcMLT^M-rs (s7 
v?*mz&z.z>w%mz-*—F<Dm-&i£it (s7 

6) „ ±IH^JS^- hOr-^^SiJSP-r-^ h7 7^©f 
-**cnt?»t«*.S (s7 7) o Mtt^xt- 

[0 0 6 2] fcfe, ±IEHSfi^l?{i, A>F3>ha 

rv>&*^ ctuw^tc, %mmm* 



®v^fek:g{b«-a-S*4fOWJ1BiT?feSo 

[0 0 6 3] %:fc\ ±i2:i— ^fUJI?^- KT«\ 1 0<D 
A>F3>hn-7 1 t lo©/*— htflfcM X'M^L 

Ltti< > £fc, il(0n>F3yFP-7f'lO0 

b *f&l»f £ cfc 7 IC L X & «fc h\ 
[0 0 6 4] jg^cO/N>Kn>hn— 7t*lo©F77 
^«SJWT5»^ #AyFn>Fn-7*^A7J?n 

[0 0 6 5] ±S9OI0B«T?H:, a»^-h (« 

iSCO^fe) ©^^^^T 1 oofilgl 4 

ffiiifO^iggB GK») fcgM^U (O^S(5^ 

31C, M I D I -fy?7i-X^LTliOffiSi 
4, tff«fflW16 0, *7H7if»8I6 

mLtcm^to fit, ^^«4, a^e^tiffl^ 
izg-wmm 4ttm f M-g« g# 

h ©i^#-r - * y u y k *w«i-r s c t *^ t * s a 

?*§ffT-feD, ^#§©^tc#{b^nfc^sg%rt« 
[0 0 6 6] c©J;-5{c/^— y^i/nyt! a— *3fdg 

y) a»a«o^««:S!«ef 

[0 0 6 7] ifiWUSB^>'?7i-X^ 
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WSlcm^TS 6 4, n.^)Vi3>e 5, ff F7A 
^?.m^LT±ie*^§s (^ifUSW 5 

C0068] c ©<t ^ nfnss f lots 

[0 0 6 9] £fc, ±fE*ffiJ£«IE±, »fl^-v b£L 
lfcffl^TV^tf, aftf^a-yhti, n^Fnyhn- 

■t * 1*3 » l t ^ g mmmw®*-wc -c z % «t 

[0070] Sfc, 01 4fc^-r«fcaf;:W;«r»f^3.-y 
F5 0fcU ^OStC 3 IftiPjiJg-tr 5 1 £Sl6i£ 

[0 0 7 1] £fc, Hll 5±ffilCjjVf «fc3£fiJfl3#<Dfll 

fcgiJ^O^y^l&OtttfS C i:Ec£ D> ^ffiSfcS* 

[0 0 7 2] \3\mTmc^?£olC^-glC3#.K 

[0073] $fc, HStai^, mmmvBM^miz. 

RfllOJIff? C t feRT^T'^So * £EC, 
[0 0 7 4] &*5, ±SB*fife^ffitCt5^T, n.-+f» 



11^^- h (Oy-l/^mWf—^ F77 
L^T'fS. Sfc, ^--yFV-^^LTftf-^?: 

5 S ihi&m-f £ i: ^ 5 5 a. U— ^ a > fe oj Bgfc % 

[0075] immmmm^ &wimmuwmmx\ 
v^T^©*of- >4?iKwra tot n 

[0 0 7 6] £fc, iS&f, WH^tt©i$&7y-r-**W 

[0 0 7 7] 

[0078] zwtffimmwmwizmmttus, '&mm 

- h Of >^*JW%fiJffl#tcBBft-r S C t EC <fc <o , CO 

/^-^0)^#^D^^i^j^fi^H^±r^7 : -^^i:^!ioa^T 

[0079] sfc, fjffl^tcisa^soaf^fcscJ 
vt^s nfc-r > # Max - ^ - ztt&ic 

EC, £P>EC{ti!CD/V- hCD7">^^CC0?g*(C-a-^^TSlJ 
ffll-rsCtfenlfilfcftSo *fc, COf-^^7h7 

[0 1 ] z<D^w<Dnmftmx&%sw)igMmwmw<D 
[02] iwigiij^#wffl]SSTffl^p>n§g»)^#7 ; - 
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[05] IBI^;/ Fny Hp— ^cD^n-y ^0 

[0 6] ±m^mmm^mmm<Dmw^tyti-^^ 
-h 

[07] ±IBS»)M#$iJffll^«^W)ft^^f 7D-f^ 
- h 

[0 8] ±iai»S5#MW«s©«if^*^-r7n-^-v 
-h 

[0 9 ] ±IB i K?g#SiJffl]g«fc «fc / n y F n y F □ - 

[01] 



[010] ±mum^m%mmm.(Dm.m&mm^-tm 
[011] i.m&mmmuwviw.nT-t-i'ay^ 

[01 2] ±fBiK^#©JffllSM07-^—>3>^ 

<?ij^^-r0 

[013] mmMmyxr-i,(Dm<Dmi&m^tm 

[0 14] jftf^P-^-y hOffl««l«^^t-0 
[0 15] m^=--y hoioli^Sta 

[^©iBBd] 

1 (^ffa.- -y h) , 2-'-ilfIn 

*) , 1 4 a~l 4 d-L E D, 16- 



[015] 




mM 2001-350474 



[0 2] 



[0 4] 



U 







































* 








































[05] 



Muffle?* 



17 



X.Y.Z 



21 



IDJ*-f >^ 



20 



mm 



23 



2.4GHz 
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[06] 



[08] 



(B) 



max* 



92 



(A) 






Y 

S42 






s43 


gttamiiflitc&fi 




S44 











Y S46 






S47 





5 



(B) 




S52 



I 
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[07] 



[0 1 2] 



(A) 




s22 



? □ -y ? £ 



s23 



N 





Y 








S24 












s25 






■r-2-tz- 





I 



(B) 




s29 




N 



S32 




s35 
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[09] 



(A) 





s60 










1 *■ 


s61 




(x.y,z)«iMSU 




s62 




(x,y,z)t*£(Cflft 




s63 




Sift 




S64 











(B) 



► 


s70 






| s71 



S72 
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